🕷️️ Job Radar • SCRAPING

freelancer.com 🟡 2026-06-01

🔹 Python Web Text Scraper to PostgreSQL Pipeline
👤 Client: 🇬🇭 Accra, Ghana Member since 2026-06-01
💰 Price: $23 / hr Average bid
🚩 Problem: Need for a lightweight, maintainable script to extract text data from a public website directly into a relational database.
📦 Existing: PostgreSQL database

Specifications:

[Target] Single public website (URL TBD)
[Method] Text-only extraction via requests/BeautifulSoup or Selenium
[Method] Pagination and crawl logic
[Stack] Python 3.x
[Stack] PostgreSQL (with class-based adapter for MySQL/SQLite)
[Security] Config file or CLI flags for DB credentials and User-Agent
[Security] Request delay settings
[Format] SQL schema/migration snippet
[Format] Logging for error tracing
[UI/UX] README documentation

Workflow:

1. Database schema definition and table creation.
2. Implementation of class-based DB adapter.
3. Development of scraping logic with pagination and error handling.
4. Integration of config-driven credentials and request settings.
5. Validation of data encoding and direct database insertion.